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TECHNICAL FIELD OF THE INVENTION 

The technical field of this invention is digital signal 
processing and more particularly control of data transfers 
within a digital signal processing system. 



BACKGROUND OF THE INVENTION 

Digital signal processing (DSP) differs significantly 
from general purpose processing performed by micro-controllers 
and microprocessors. One key difference is the strict 
requirement for real time data processing. For example, in a 
modem application, it is absolutely required that every sample 
be processed. Even losing a single data point might cause a 
digital signal processor application to fail. While processing 
data samples may still take on the model of tasking and block 
processing common to general purpose processing, the actual 
data movement within a digital signal processor system must 
adhere to the strict real-time requirements of the system. 

As a consequence, digital signal processor systems are 
highly reliant on an integrated and efficient direct memory 
access (DMA) engine. The direct memory access controller is 
responsible for processing transfer requests from peripherals 
and the digital signal processor itself in real time . All 
data movement by the direct memory access must be capable of 
occurring without central processing unit (CPU) intervention 
in order to meet the real time requirements of the system. 
That is, because the CPU may operate in a software tasking 
model where scheduling of a task is not as tightly controlled 
as the data streams the tasks operate on require, the direct 
memory access engine must sustain the burden of meeting all 
real time data stream requirements in the system. 
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The early direct memory access has evolved into several 
successive versions of centralized transfer controllers and 
more recently into the transfer controller with hub and ports 
architecture. The transfer controller with hub and ports 
5 architecture is described in U.K. Patent Application No. 

9901996.9 filed April 10, 1999 entitled "TRANSFER CONTROLLER 
WITH HUB AND PORTS ARCHITECTURE." 

A first transfer controller module was developed for the 
TMS330C80 digital signal processor from Texas Instruments. The 

10 transfer controller consolidated the direct memory access 

function of a conventional controller along with the address 
generation logic required for servicing cache and long 
distance data transfer, also called direct external access, 
from four digital signal processors and a single RISC (reduced 

15 instruction set computer) processor. 

The transfer controller architecture of the TMS330C80 is 
fundamentally different from a direct memory access in that 
only a single set of address generation and parameter 
registers is required. Prior direct memory access units 

20 required multiple sets for multiple channels. The single set 

of registers, however, can be utilized by all direct memory 
access requestors. Direct memory access requests are posted 
to the transfer controller via set of encoded inputs at the 
periphery of the device. Additionally, each of the digital 

25 signal processors can submit requests to the transfer 

controller. The external encoded inputs are called "externally 
initiated packet transfers" (XPTs) . The digital signal 
processor initiated transfers are referred to as "packet 
transfers" (PTs) . The RISC processor could also submit packet 

30 transfer requests to the transfer controller. 

- 3 - 
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The transfer controller with hub and ports introduced 
several new ideas concepts. The first was uniform pipelining. 

New digital signal processor devices containing a transfer 
controller with hub and ports architecture have multiple 
external ports, all of which look identical to the hub. Thus 
peripherals and memory may be freely interchanged without 
affecting the hub. The second new idea is the concept of 
concurrent execution of transfers. That is, up to N transfers 
may occur in parallel on the multiple ports of the device, 
where N is the number of channels in the transfer controller 
with hub and ports core. Each channel in the transfer 
controller with hub and ports core is functionally just a set 
of registers. This set of registers tracks the current source 
and destination addresses, the word counts and other 
parameters for the transfer. Each channel is identical, and 
thus the number of channels supported by the transfer 
controller with hub and ports is highly scaleable. 

Finally the transfer controller with hub and ports 
includes a mechanism for queuing transfers up in a dedicated 
queue memory. The TMS320C8 0 transfer controller permitted 
only was one transfer outstanding per processor at a time. 
Through the queue memory provided by the transfer controller 
with hub and ports, processors may issue numerous transfer 
requests up to the queue memory size before stalling the 
digital signal processor. 
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SUMMARY OF THE INVENTION 

In a transfer controller with hub and ports, the request 
queue manager is the hub front-end which operates in 
conjunction with a transfer request bus to handle incoming 
requests. The queue manager control unit sorts these requests 
by their respective priorities and stores them in the queue 
manager memory. The queue manager memory could take several 
forms, but is preferably RAM based. 

The queue manager memory is partitioned into multiple 
queues. Each queue represents a priority level with which 
access requests in that queue should be performed by the 
transfer controller hub. The number of channels in the 
request queue manager is highly scalable, and controlled via 
a set of queue bounds registers within the request queue 
manager. The queue manager also processes read requests from 
the transfer controller hub and supplies the next queued 
request to the hub on a per channel basis. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

These and other aspects of this invention are illustrated 
in the drawings, in which: 

Figure 1 illustrates in a functional block diagram, the 
basic principal features of the transfer controller with hub 
and ports; 

Figure 2 illustrates the request queue manager interface 
to the transfer controller with hub and ports hub unit; and 

Figure 3 illustrates the functional block diagram of the 
request queue manager. 
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DETAILED DESCRIPTION OF THE INVENTION 

The request queue manager function is a crucial part of 
the centralized transfer controller with hub and ports 
architecture. To understand its various performance aspects 
it is helpful to consider first the transfer controller as a 
whole . 

The transfer controller with hub and ports transfer 
controller with hub and ports architecture is optimized for 
efficient passage of data throughout a digital signal 
processor chip. Figure 1 illustrates a block diagram of the 
principal features of the transfer controller with hub and 
ports. It consists of a system of a single hub 100 and 
multiple ports 111 through 115. At the heart of the hub is 
the transfer controller with hub and ports hub control unit 
109 which acts upon request and status information to direct 
the overall actions of the transfer controller. 

The transfer controller with hub and ports functions in 
conjunction with a transfer request bus having a set of nodes 
117 , which bring in transfer request packets at input 103. 
These transfer request bus nodes individually receive transfer 
requests packets from transfer requestors 116 which are 
processor-memory nodes or other on-chip functions which send 
and receive data. 

Secondly, the transfer controller uses an additional bus, 
the data transfer bus having a set of nodes 118, to read or 
write the actual data at the requestor nodes 116. The data 
transfer bus carries commands, write data and read data from 
a special internal memory port 115 and returns read data to 
the transfer controller hub via the data router 150 at inputs 
104. 
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The transfer controller has, at its front-end portion, a 
request queue manager 101 receiving transfer requests in the 
form of transfer request packets at its input 103. Request 
queue manager 101 prioritizes, stores and dispatches these as 
5 required. 

Request queue manager 101 connects within the transfer 
controller hub unit 100 to the channel request registers 120 
which receive the data transfer request packets and process 
them. In this process, request queue manager 101 first 
10 prioritizes the transfer request packets and assigns them to 

one of the N channel request registers 120. Each of the N 
Ji channel request registers 120 represents a priority level. 

^ If there is no channel available for direct processing of 

y the transfer request packet, it is stored in the queue manager 

2} 15 memory 102. Queue manager memory 102 is preferably a random 

J| access memory (RAM) . The transfer request packet is then 

!\ assigned at a later time when a channel becomes available. 

M> The channel registers interface with the source 130 and 

?!j destination 140 control pipelines which effectively are 

Q 20 address calculation units for source (read) and destination 

(write) operations. 

Outputs from these pipelines are broadcast to M ports 
through the transfer controller ports I/O subsystem 110. I/O 
subsystem 110 includes a set of hub interface units, which 
25 drive the M possible external ports units. Four such external 

ports are shown in Figure 1 as external ports 111 through 114. 
The external ports units (also referred to as application 
units) are clocked either at the main processor clock 
frequency or at a different external device clock frequency. 
30 The external device clock frequency may be lower than or 
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higher than the main processor clock frequency. If a port 
operates at its own frequency, synchronization to the core 
clock is required. 

As an example of read-write operations at the ports, 
consider a read from external port node 112 followed by a 
write to external port node 114. First the source pipeline 
addresses port 112 for a read. The data is returned to the 
transfer controller hub through the data router unit 150. On 
a later cycle the destination control pipeline addresses port 
114 and writes the data at port 114. External ports as 
described here do not initiate transfer requests but merely 
participate in reads and writes requested elsewhere on the 
chip. Read and write operations involving the processor- 
memory (transfer requestors) nodes 116 are initiated as 
transfer request packets on the transfer request bus 117. The 
queue manager 101 processes these as described above. On a 
later cycle a source pipeline output (read command/address) is 
generated which is passed at the internal memory port to the 
data transfer bus 118 in the form of a read. This command 
proceeds from one node to the next in pipeline fashion on the 
data transfer bus. When the processor node addressed is 
reached, the read request causes the processor-memory node to 
place the read data on the bus for return to the data router 
150. On a later cycle, a destination pipeline output passes 
the corresponding write command and data to the internal 
memory port and on to the data transfer bus for writing at the 
addressed processor node. 

The channel parameter registers 105 and port parameters 
registers 106 hold all the necessary parametric data as well 
as status information for the transfer controller hub 
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pipelines to process the given transfer. Both pipelines share 
some of the stored information. Other portions relate 
specifically to one pipeline or the other. 

Figure 2 illustrates the interface of request queue 
manager 101 to the transfer controller hub unit boundary and 
particularly the request queue manager communications with the 
channel request registers 200, channel parameters registers 
105 and port parameters registers 106. Channel parameters 
registers 105 and port parameters registers 106 store critical 
data regarding for example, types of transfers, mode 
information, status, and much other information critical to 
the transfer process. 

Channel request registers 200 pass information used in 
the source control pipeline 130 for generation of the read/ 
pre-write commands 251. Similarly, channel request registers 
200 pass information used in the destination control pipeline 
140 for the generation of write command/write data words 252. 
Read response data 104 from the ports is returned to the 
destination pipeline via the data router unit 150. 

Detailed View of the Queue Manager 

Request queue manager 101, illustrated in Figure 3, 
operates in conjunction with the transfer request bus 212 and 
handles incoming requests. Queue manager control unit 201 
sorts these requests by their priorities and stores them in 
the queue manager memory 102. Queue manager memory 102 may 
take several forms, but is preferably random access memory 
(RAM) based. 

Queue manager memory 102 may be partitioned into multiple 
queues. Each such queue represents a priority level with 
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which access requests in that queue should be performed by the 
transfer controller hub. Figure 3 shows six priority levels 
210, labeled CHO through CH5. The number of channels in 
request queue manager 101 is highly scalable, and controlled 
5 via a set of queue bounds registers 203 within request queue 

manager 101. The number of queue bounds registers determines 
the number of queues. Each queue within request queue manager 
101 may be of different size, however each queue must contain 
at least enough memory space to store a single transfer 
10 request. 

Request queue manager 101 also processes channel requests 

OJ from the transfer controller hub 211 and supplies the next 

y queued request to the hub on a per channel (1 channel per 

y priority level) basis. 

J 15 

*|| Request Queue Manager-Transfer Request (TR) Bus Interface 

* # Transfer requests from the transfer request bus 212 sent 

U to request queue manager 101 are sorted and stored in the 

queue manager memory 102 until the transfer controller hub can 
0 20 process them. A priority field of the first double word on an 

incoming transfer request determines its priority and is used 

to select into which of the queues the transfer request will 

be placed. 

Write pointer logic, which is part of the queue bounds 
25 registers 203 and read/write pointer block 204, will increment 

the address only after each write and then only if the signal 
allowing queue manager memory 102 bypass is not active. If 
this increment causes the address to be equal to the next 
successive queue bounds value, then the next address will be 
30 reset to the original queue bounds value for that queue. 

- 11 - 
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As an optional enhancement, it is possible to bypass 
request queue manager 101 when an incoming transfer request 
packet is addressed to a currently empty queue and the 
transfer controller hub channel to which that queue 
corresponds is idle. This condition is detected by comparing 
the read and write pointers for the appropriate queue. If the 
read and write pointers are equal, the queue channel is empty- 
Further inspection of the channel status within transfer 
controller hub 100 can detect the idle condition. Thus the 
transfer request parameters may be directly loaded into the 
transfer controller hub channel registers 120. This has the 
advantage of reducing latency on access requests. In the 
case of queue manager storage bypass, request queue manager 
101 read and write pointers 204 for the appropriate channel 
are not incremented. 

Request Queue Manager Hub Interface 

Transfer controller hub 100 accepts the next entry in 
request queue manager 101 as soon as the respective channel 
becomes available (i.e. the previous request for that channel 
has completed) . These reads are on a per-channel basis with 
the highest priority being serviced first. This requires a 
"data ready" signal 221 to be sent back to each of the 
channels indicating when the respective channel is being 
serviced by request queue manager 101. Data is sent to the 
transfer controller hub via the path 222 shown in Figure 3. 
For each read from queue manager memory 102, the read pointer 
204 is incremented except in the case of queue manager storage 
bypass as noted above. 



- 12 - 
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Request queue manager 101 can issue only one store or one 
transfer request at a time. The "Channel Request from Hub" 
signal 211 has a priority level higher than the "Request from 
the TR Bus" signal 212. If there is a conflict between 
channel request from hub 211 and request from transfer request 
bus 212, the latter is interrupted until the channel request 
is served. Channel request service is allocated the CHO 
priority level, which is the highest priority level, and is 
served first . 

Request Queue Manager Requestor Disable 

Requestor disable register block 206 is included in 
request queue manager 101. Transfer request "reads" that have 
a requestor ID that has been disabled via requestor disable 
register block 206 will be ignored. Request queue manager 101 
will continue to advance to the next request in the queue 
until one that is not disabled is located, or the queue is 
empty. Request disable register block 206 is memory mapped 
and can be accessed through internal memory port 115 
illustrated in Figures 1 and 2. 

Request Queue Manager Requestor ID Acknowledgement (QACK) 

Request queue manager 101 has an extra duty to inform the 
transfer request nodes 116 when one of the transfer requests 
has been taken out of its priority queue and passed to the 
transfer controller hub for processing. This is required to 
notify the individual transfer request nodes 116 when reserved 
queue slots have freed up. Then transfer request nodes 116 
can increment their counter value and issue another request if 
the counter was zero. The requestor ID QACK signal 226 is 
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sent when it is read out of queue manager memory 102 for the 
transfer controller hub. The requestor ID QACK signal 226 is 
passed along transfer request nodes 116 on another bus 
paralleling the transfer request bus. Each transfer request 
node 116 can verify that the requestor ID QACK was sent during 
that cycle and update their counters if applicable. A valid 
bit is included on this additional bus to qualify when the 
requestor ID was read out. 

Request Queue Manager Datapath Summary 

In summary, the datapath in request queue manager 101 
consists of three main parts. The first is the queue manager 
control unit 201. This functional block takes in the channel 
request transfer request packet 211, transfer request node 
transfer request packet 212, and the queue manager "queue 
empty" 218 information from the hub. It then decodes the 
channel register transfer request packet, compares it with the 
"queue empty" information to check if any transfer request 
packet is ready to be transferred. If there is a transfer 
packet and a "channel ready", queue manager control unit 201 
then issues the channel number, issues a read enable to 
request queue manager 101 main data path to read the packets 
from queue manager RAM. If there is no transfer packet or 
"channel ready", queue manager control unit 201 will then do 
a transfer request write to queue manager memory 102 provided 
there is a transfer request. If there is a transfer request 
and a "channel ready", queue manager control unit 201 then 
issues the channel number and read enable to request queue 
manager 101 main data path to read the packets from queue 
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manager memory 102 and also do the transfer request write to 
queue manager memory 102. 

The second part of request queue manager 101 datapath is 
the main datapath. It has N read pointer counters and N write 
pointer counters for N queues, all a part of block 203/204. 
For this example N equals six because there are six priority 
levels. Based on whether a read or write operation is issued, 
request queue manager 101 datapath selects the read or write 
pointer of the corresponding queue. The datapath also detects 
whether the pointer will pass beyond the queue boundary. If 
the next address will go beyond the upper queue boundary, it 
will reset the next address to the lower queue boundary. 

Request queue manager 101 main datapath also has N-l 
queue bound registers, which may be globally memory mapped. 
These N-l queue bound registers are also a part of queue 
bounds registers 203. The queue bounds registers define the 
lower and upper bounds of the N queues. When they are reset 
to a new value, both the corresponding read and write pointers 
are reset to the bottom of the queue immediately. 
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1 1. A method of prioritizing data transfer requests 

2 serviced by a centralized data transfer unit comprising the 

3 steps of: 

4 receiving transfer request packets, each transfer request 

5 packet indicating a desired data transfer and a priority level 

6 within a hierarchy of a plurality of priority levels; 

7 storing each received transfer request packet in a queue 

8 memory, each received transfer request packet stored in a 

9 first-in-first-out fashion within each priority level; 

10 detecting availability of free data transfer channel 

11 among a plurality of data transfer channels within said 

12 centralized data transfer processor; and 

13 dispatching a next transfer request packet in said first- 

14 in-first-out fashion to the corresponding free data transfer 

15 channel. 

1 2. The method of claim 1, wherein: 

2 said step of storing each received transfer request 

3 packet in a queue memory includes 

4 storing each received transfer request packet in a 

5 random access memory fashion, 

6 defining an address range within said queue memory 

7 allocated to each priority level with a corresponding 

8 queue bounds register, 

9 storing a next input transfer request packet for a 

10 priority level at address within said queue memory 

11 indicated by a corresponding queue write pointer 

12 indicating address location, and 
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13 reading a next output transfer request packet for a 

14 priority level from an address within said queue memory 

15 indicated by a corresponding queue read pointer. 

1 3. The method of claim 2, further comprising the steps 

2 of: 

3 incrementing the corresponding queue write pointer upon 

4 storage of a transfer request packet in queue memory; memory 

5 and 

6 decrementing the corresponding queue read pointer upon 

7 transfer of a transfer request packet to a data transfer 

8 channel. 

1 4. The method of claim 2, further comprising the steps 

2 of: 

3 dynamically defining said address range allocated to a 

4 priority level by dynamically writing to a corresponding queue 

5 bounds register . 

1 5. The method of claim 1, further comprising the steps 

2 of: 

3 detecting if a channel corresponding to a priority level 

4 within the queue is empty; and 

5 if a received transfer request packet of has a priority 

6 level detected to be empty 

7 bypassing storing said transfer request packet in 

8 said queue memory, and 

9 dispatching said transfer request packet directly 
10 to the corresponding free data transfer channel. 
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6. The method of claim 1, further comprising the steps 

of: 

generating said transfer request packets at each of a 
plurality of transfer request nodes; and 

upon dispatching of a transfer request packet to a free 
data transfer channel, sending a queue acknowledge signal to 
said transfer request node originating said transfer request 
packet . 

7. The method of claim 1, further comprising the steps 

of: 

generating said transfer request packets at each of a 
plurality of transfer request nodes , said transfer request 
packet identifying said originating transfer request node; 

disabling dispatching transfer request packets 
originating from selected transfer request nodes; and 

ignoring transfer request packets originating from 
disabled transfer request nodes. 

8. The method of claim 8, wherein: 

said step of disabling dispatching transfer request 
packets originating from selected transfer request nodes 
includes writing at least one to a corresponding location 
within a request disable register. 

9. The method of claim 9, wherein: 

the number of data transfer channels equals the number of 
priority levels. 
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ABSTRACT 



1 A transfer controller with hub and ports is viewed as a 

2 communication hub between the various locations of a global 

3 memory map. A request queue manager serves as a crucial part 

4 of the transfer controller. The request queue manager 

5 receives these data transfer request packets from plural 

6 transfer requests nodes. The request queue manager sorts 

7 transfer request packets by their priority level and stores 

8 them in the queue manager memory. The request queue manager 

9 processes dispatches transfer request packets to a free data 

10 channel based upon priority level and first-in-first-out 

11 within priority level. 
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